Nonextensive aspects of self-organized scale-free gas-like networks 
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We explore the possibility to interpret as a 'gas' the dynamical self-organized scale-free network 
recently introduced by Kim et al (2005). The role of 'momentum' of individual nodes is played by 
the degree of the node, the 'configuration space' (metric defining distance between nodes) being 
determined by the dynamically evolving adjacency matrix. In a constant-size network process, 
'inelastic' interactions occur between pairs of nodes, which are realized by the merger of a pair of 
two nodes into one. The resulting node possesses the union of all links of the previously separate 
nodes. We consider chemostat conditions, i.e., for each merger there will be a newly created node 
which is then linked to the existing network randomly. We also introduce an interaction 'potential' 
(node- merging probability) which decays with distance dij as l/d[j {a > 0). We numerically exhibit 
that this system exhibits nonextensive statistics in the degree distribution, and calculate how the 
entropic index q depends on a. The particular cases a = and a oo recover the two models 
introduced by Kim et al. 



PACS numbers: 05.70.Ln, 



1. 75. He, 89.75.-k 



o 
o 



> 
o 

o 
vn 
o 



I 

O 

o 



X 



I. INTRODUCTION 

A common feature in several recent approaches to com- 
plex networks with statistical mechanical methods is the 
definition of network Hamiltonians Q, |^ Q . Such Hamil- 
tonians currently depend on the number of links either 
on a global level, or on the degree of individual nodes. 
This definition allows to borrow powerful concepts from 
statistical physics such as the maximum entropy princi- 
ple which may provide the most probable ensembles 
of networks. Further, Hamiltonians allow to define both 
thermodynamical ensembles (microcanonical, canonical, 
grand canonical) 2, 4] and a partition function, which 
opens the way to compute degree correlation functions 
in a formalism most familiar to physicists P, Q . 

However, these approaches do not yet aim to explain 
the structure of degree distributions, and mainly address 
random networks. A conceptually different approach has 
been taken recently in 5j , where networks are embedded 
in some metric space and the definition of entropy in net- 
works is broadened. In this work it was noted that the 
characteristic distribution of the relevant degree of free- 
dom - the degree of nodes - appears to coincide to distri- 
bution functions known for nonextensive systems 0, 01 ■ 
More precisely, in Q it was found that, for some prefer- 
ential attachment network growth models, the resulting 
degree distributions are of the q- exponential type (defined 
later on) . In the usual preferential attachment model, the 
probability of a new node (i.e., being added to a network) 
to attach its link to a pre-existing node i is proportional 
to this node's number of hnks, or degree fc^, i.e., pa oc /c,. 
This is also true for networks embedded in i?" , where the 
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linking probabilities are made dependent on the relative 
distance of node i to the new node, i.e., pA oc ki/d^. 
Here a is a free parameter that defines the connecting 
horizon of a new node to the system. For large a the 
node will link with high probability to a nearby node, 
whereas distance becomes irrelevant for a — > 0. 

A problem which has not yet been explored in the lit- 
erature is that of a definition of an interaction between 
nodes, for example in the way one would think of an inter- 
action of gas molecules. In classical statistical mechan- 
ics interactions/collisions between gas particles result in 
a transfer of momentum from one particle to another, 
under the constraint that momentum is conserved. In 
elastic interactions this results in a change of direction 
and speed of particles after a collision, in inelastic ones 
also in a change of masses of the particles. In this pa- 
per we find that the class of self-organizing networks as 
introduced in opens the possibility to define an 'inter- 
action' between nodes of a network. In analogy to the 
momentum transfer in the classical situation, in the net- 
work case the interactions are defined by a transfer of 
links. This enables one to think of a network as some 
sort of gas, which turns out to be describable by distri- 
bution functions characteristic of nonextensive statistical 
mechanics. 



II. MODEL 

Let us consider the following gas-like system. Parti- 
cles have links among them. The total number of links 
of a given node is a characteristic quantity of the node, 
such as the momentum of an ordinary particle. The par- 
ticles of this 'gas' have no momentum but only their de- 
gree. Neither do the particles have an absolute position 
in space. They possess only a relative distance dij to 
each other which is given by the shortest number of links 
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between them (sometimes called chemical distance) . Par- 
ticles can interact 'non-elastically'. Upon an interaction 
one particle ceases to exist and transfers all its links to the 
other. If the interacting particles i and j have both had 
links to a third particle k before the interaction, the re- 
maining particle i will keep its link to k, while the links of 
the disappeared particle j to k will be removed, meaning 
that links are only counted once (and are not weighted). 
Consider these interactions taking place in a chemostat, 
such that the number of particles in a closed system is 
constant. This means that, for every merging interac- 
tion, a new particle will be introduced to the system. 
The interaction is characterized by the probability that 
two particles meet and transfer links. Given a 'metric' 
(relative network distance) this probability can be made 
distance-dependent as in To do this we introduce a 
power like potential. 

In what follows we numerically study the distribution 
of the characteristic degree of freedom (the degree of 
nodes) as a function of the range of the interaction. As 
in [3 , we find that the distribution of this (nonextensive) 
'gas' is described by a q-exponential. 

A. Network dynamics 

There has been a recent suggestion to model scale- 
free networks of constant size, the so-called self-organized 
networks 0- The idea is that at any given timestep 
one single pair of nodes, say i and j, merge together to 
become one single node. This node keeps the name of 
one of the original nodes, say for example i. This node 
now gains all the links of the other node j, resulting in a 
change of degree for node i according to 

h h + kj - iVcommon,if («, j) not first neighbors 

h ^ h + kj - iVcommon " 2, if (i, j) first neighbors 

(1) 

where -/Vcommon is the number of nodes, which shared 
links to both of i and j before the merger. In the case 
that i and j were first neighbors before the merger, i.e., 
they had been previously linked, the removal of this link 
will be taken care of by the term —2 in Eq. Next, 
to keep the system at constant size, a new node is cre- 
ated, and is linked to r randomly chosen nodes from the 
existing network. Let us note here that the smallest de- 
gree found in a network can only be larger or equal to 
r. This will have consequences for the normalization of 
distribution functions as will be discussed below. In the 
following (except for Fig. [2Jl we will restrict ourselves to 
r = 2, for simplicity. Thus the smallest degree will al- 
ways be 2. (This is not at all an important restriction; 
as an alternative the actual number of links can also be a 
random number picked, e.g. from a uniform distribution 
with an average of (r), as in Q). After that we address 
the next timestep. Nodes in the network start with a 
small number of links, and gain links through merger- 
interactions. Links to the iVcommon common neighbors of 
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FIG. 1: Simulation of Eq. (Q of a iV = 2'^ network with r = 2 
and a = (random scheme). Time evolution of the degree 
of (a) the most connected node during the simulation; (b) an 
individual, randomly chosen node. 



two merging nodes are lost as mentioned above, which 
reduces the number of links. Gains and losses eventu- 
ally lead to an effective balance over time as shown for 
instance in Fig. ^a. The number of links of the best con- 
nected node in the system is followed over time. After 
about 1000 timesteps a stationary state is reached. The 
situation for an individual link is shown in Fig. ^ b. A 
node starts with r — 2 links when it is introduced to the 
system. It gains links through mergers over time. When 
the node is taken up in a merger it disappears from the 
system and, as said before, a new one starts with r = 2 
links again. Networks with these rewiring scheme lead 
to scale-free degree distributions i.e. the power expo- 
nent of the cumulative degree distribution tail behaves as, 
P(> fc) - fc~T. In two schemes were discussed: The 
case where only nodes being first-neighbors can merge, 
and the case where any two nodes - directly connected 
or not - can merge with the same probability for each 
possible pair (i,j). The neighbor scheme leads to an ex- 



FIG. 2: Cumulative degree distributions for various system 
sizes A'' for the neighbor scheme, as reported in 9] with (r) = 
8. Degrees are from individual states of networks without 
averaging over identical realizations. On the right side the 
exponential finite size effect is seen. 



ponent 7 ~ 1.3, the random scheme to 7 ~ 0.5. The 
cumulative degree distribution, for the neighbor scheme 
is shown in Fig. [21 

These distributions can be fit by q-exponentials, 



^'(> fc) - e-('=-2)/« (fc = 2,3,4,...) , 



(2) 



where the g-exponential function is defined, for 1 + (1 

qc)x > 0, as 



[1 + (1 - qc 



ll/(l-9c) 



(3) 



with K > some characteristic number of links, and 
7 = l/(gc — 1) being the tail exponent of the (asymp- 
totic) power-law distribution. Whenever we talk about q- 
values corresponding to a cumulative distribution, we use 
the notation q^., where c stands for cumulative. We have 
normalized with the value corresponding to the smallest 
possible degree (which in our case equals 2) in order to 
have P(> 2) = 1. 

A convenient procedure to perform a two-parameter fit 
of this kind is to take the q-logarithm of the distribution 
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This is 



P, defined by Zg = In, P(> k) _ 
done for a series of different values of qc- The function Zq 
which is best fit with a straight line determines the value 
of qc, the slope being —k. The situation for the N — 2^^^ 
data of Fig. [21 is shown in Fig. [21 for qc running between 
1 and 2.6. 

We numerically verify with good precision that the 
Ansatz in Eq. ||2Il for the cumulative degree distribution 
is a satisfactory one (it could even be the exact one for 
the present problem). This reveals a connection [sl ITo| 
of scale- free network dynamics to nonextensive statistical 
mechanics Let us be more specific. Consider the 

entropy 



FIG. 3; g-logarithm of the cumulative distribution function 
from the previous figure as a function of the degree k. Clearly, 
there is a qc which allows for an optimal linear fit. Inset: Lin- 
ear correlation coefficient r of Zq{k). The value of is ob- 
tained where Zq is optimally linear, i.e., where the correlation 
coefficient is maximal. In this example we obtain = 1.84, 
which corresponds to the slope 7 = 1.19 in the previous plot. 
The continuous curves are guides to the eye. 
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where we assume fc as a continuous variable for simplicity, 
and BG stands for Boltzmann-Gibbs. If we extremize Sq 
with the constraints [Ml 



dkp{k) = 1 



and 

we obtain 

p{k) = 



J^dkk[pik)]i 



= K, 



(5) 



(6) 



-/3(fc-2) 



dk' e, 



-f3(k'-2) 



-/3(fc-2) 



(fc>2), 
. . 

where [3 is determined through Eq. ©. Both positivity 
of p{k) and normalization constraint Q impose q < 2. 
The corresponding cumulative distribution P{> fc) is 
then given by 



F(> k) = l-J^ dk'p{k') = [l-(l-g)/3(fc-2)] 



-2)|T^ . (8) 
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FIG. 4: Cumulative degree distribution for a = 2^ network 
with r = 2, for typical values of a. For fc > 30 finite size ef- 
fects (such as those illustrated in Fig. 2) emerge. Solid lines 
are the g-exponentials from the fitted parameters qc and k, 
shown in Fig. I^a. Inset: the same data in q-logarithm vs. 
linear representation, where we have used, for each value of 
a the corresponding value of qc- For a ranging within the 
interval [0, 7] we verify that the corresponding linear correla- 
tion coefficient ranges within the interval [0.999901, 0.999976]. 
The slope equals — k for each curve (see also inset of Fig. |3 
a). 



This expression can be rewritten precisely as the Ansatz 
(0) with 
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1 



2-q 



(2 - q)P 



(9) 



B. 



Network distance and distance-dependent 
re-linking potential 



Unlike the two schemes in the original presentation of 
self-organizing networks, the neighbor and the random 
scheme, we would like to define a distance-dependent 
merging probability. This needs a definition of distance 
on the graph. For simplicity we define the distance dij, 
between two nodes i and j on an undirected graph as 
the shortest distance, given all links are of unit length. 
This distance is obtained, for instance, from the Dijkstra 
algorithm |^ . We randomly choose a node (denoted by 
i) and then choose the second node (denoted by j) of the 
merger with probability 



p^^ = Mr." {a > 0) 



(10) 



where J\f — 1/ dj^" is a normalization that makes pij 
a probability, and dij is the shortest distance (path) on 
the network connecting nodes i and j; a is a real number. 
Obviously, tuning a from toward large values switches 
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FIG. 5: (a) Dependence of the extensivity parameter q^ on 
the potential parameter a for a A'^ = 2^, r = 2, network. 
The solid line is an exponential fit to the data points: qc = 
1.675 + 1.1809 6"°''*^". We might thus conjecture for the 
exact answer, the form qda) — gc(oo) + [qc{0) — qdoo)] e~^" 
with A ~ 1. Inset: a- dependence of k. (b) Network size 
dependence of the qc(ci) function, for nodes A'^ — 2^,2^,2^. 
The solid line corresponds to the asymptotic value for large 
a reported in (neighbor scheme), i.e., qc(po) = 1.76. The 
value for the a = model as reported in Q corresponds to 
qc{0) ~ 3 (empty circle). The conjectural form is indicated 
with A = 1 (dashed line). 



the model from the random to the neighbor scheme in 



III. RESULTS 



Realizing this distance-dependent potential in a nu- 
merical simulation we find the degree distributions given 
in Fig. 21 All following data was obtained from averages 
over 1000 identical realizations of degree distributions of 
networks with a number of nodes, N = 2^. Networks 
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have been recorded after 5 network updates. A network 
update is performed when N mergers have taken place. 
This corresponds to the 5x2^ timesteps shown in Fig. 
□ 

From these degree distributions we obtain the index 
Qc and the characteristic degree k. Their dependence on 
a is given in Fig. [S] The a-dependence of Qc shows 
the expected tendency. Our result in the limit a — > 0, 
?c(0) = 2.8 corresponds to an exponent 7 = 0.55, which 
is about 10 percent lower than the reported value in 0. 
The reason for this small discrepancy seems to be a finite- 
size effect. 

To demonstrate that this might indeed be so, in Fig. 
b we plot the gc(Q:)-dependence for = 2^, = 2^ and 
2^ networks for comparison. As network size increases 
the value of qc approaches the expected value of 3 |3| in 
the small a limit. For the a 00 limit, the expected 
value is recovered for the A^ = 2^ network, for smaller 
networks, there is still a visible size effect. This size effect 
is related to the problem that the finite size cutoff plays 
a relatively large role, and interferes considerably in the 
fits in small networks. Simulations on larger networks 
are certainly desirable, but inaccessible to our present 
computational power. 

IV. DISCUSSION 

To summarize, we have explored the possibility to 
making some connection between a nonextensive gas and 



a self-organized scale-free network. We have shown that 
the characteristic degree distributions are well described 
by q-exponentials whose parameters vary with the in- 
teraction range, i.e. a. The limiting cases a — *■ and 
a — > c» reproduce the situations given in , namely the 
neighbor merging and the random merging. 

In the present work we have used the network's in- 
trinsic metric space, i.e., its adjacency matrix, to mea- 
sure distances (dy ) between nodes to be merged. This 
is in variance with what is done in 5], where the net- 
work is embedded in a 'geographical' metric space (with 
distances ry). Both models can of course be unified by 
introducing both merging (with probability oc and 
distance-dependent linking (with probability oc l/r^"*, 
where A stands for attachment) . The degree distribution 
of such a unified model could still be of the g-exponential 
form with qc{a,aA)- Of course, qc{a,0) — qdo) as 
given in the present paper. It would not be surprising 
if qc{a,aA) was a monotonically decreasing function of 
both variables a and a a, with the maximal value being 
(7c(0, 0), and with say qc{a, 00) = 1, Va > 0. In such a 
case, the interval spanned by qc would clearly be wider 
than that of the present model. 
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